stochastic gradient descent convergence

After $T=\frac{R^2 G’^2}{\epsilon^2}$ iterations,

Proof

Using Jensen's inequality:

#incomplete

see: stochastic gradient descent

References: 1.